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Abstract — We present analytical expressions for optimal 
entropy-constrained multiple-description lattice vector quantizers 
which, under high-resolutions assumptions, minimize the ex- 
pected distortion for given packet-loss probabilities. We consider 
the asymmetric case where packet-loss probabilities and side 
entropies are allowed to be unequal and find optimal quantizers 
for any number of descriptions in any dimension. We show that 
the normalized second moments of the side-quantizers are given 
by that of an L-dimensional sphere independent of the choice of 
lattices. Furthermore, we show that the optimal bit-distribution 
among the descriptions is not unique. In fact, within certain 
limits, bits can be arbitrarily distributed. 

I. Introduction 
Multiple-description coding (MDC) aims at creating sepa- 
rate descriptions individually capable of reproducing a source 
to a specified accuracy and when combined being able to 
refine each other. Traditionally quantizer based MDC schemes 
consider only two descriptions [1]— [10]. Among the few vector 
quantizer based approaches which consider more than two de- 
scriptions are [11]— [14]. In [13], [14] closed form expressions 
for the design of lattice vector quantizers are given for the 
symmetric case where all packet-loss probabilities and side 
entropies are equal. In [11], [12] iterative vector quantizer 
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Fig. 1 . General if-channel system. Descriptions are encoded at an entropy of 
Ri, i = 0, . . . , K — 1, The erasure channel either transmits the ith description 
errorless or not at all. 

design algorithms are proposed for the asymmetric case where 
packet-loss probabilities and side entropies are allowed to be 
unequal. 

In this paper we consider the asymmetric case for an 
arbitrary number of descriptions, where the ith description is 
encoded at an entropy of Ri, for i — 0, . . . , K — 1, see Fig. [2 
The total rate is then given by the sum of the entropies of 
the individual descriptions. Due to the asymmetry, the total 
distortion depends not only on how many descriptions are 
received (as is the case in the symmetric situation [13], [14]), 
but also on which descriptions make it to the decoder. We 



derive analytical expressions for the central and side quantizers 
which, under high-resolution assumptions, minimize the ex- 
pected distortion at the receiver subject to entropy constraints 
on the total rate. In contrast to [11], [12] our design allows 
for simple adaptation of our quantizers to changing source- 
channel characteristics and entropy constraints, effectively 
avoiding iterative quantizer design procedures. 

II. Preliminaries 
Let X £ R L be an arbittary i.i.d. source and let Acl i 
be a real lattice with Voronoi regions V^(A), A £ A, given by 

V(X) = {x £ R L : \\x - A|| 2 < \\x - A'|| 2 , VA' £ A}, 

where x is a realization of X and we define ||a;|| 2 = j^x T x, 
where T denotes vector ttansposition. 

We consider one central lattice (central quantizer) A c and 
several sublattices (side quantizers) A,, where i = 0, . . . , K—l 
and K > 0, is the number of descriptions. The trivial case 
K = 1 leads to a single-description system, where we would 
simply use one central quantizer and no side quantizers. We 
assume that sublattices are geometrically similar to A c , i.e. 
they can be obtained from A c by applying change of scales, 
rotations and possible reflections. The sublattice index N{ = 
[A c : Aj],iVj £ Z + , of the ith sublattice Aj describes the 
volume Vi of a sublattice cell relative to the volume v of a 
central lattice cell. The volume vi of the ith sublattice cell is 
then given by Vi = NiV. In the design of the index assignment 
map, we make use of a product lattice A^ C A» C A c , which 
is simply a sublattice of index N n — [A c : A^]. To simplify 
the design of the index assignment map we assume sublattices 
are clean [15], specifically we require that no points of A c lies 
on the boundaries of the Voronoi regions of A T . 

A. Index assignments 

A source vector x is quantized to the nearest reconstruction 
point A c in the central lattice A c . Hereafter follows index 
assignments (mappings), which uniquely map all A c 's to re- 
construction points in each of the sublattices Aj. This mapping 
is done through a labeling function a, and we denote the 
individual component functions of a by cti. In other words, 
the injective map a that maps A c into Aq X • • • x Ak-i, is 
given by 

ce(Xc) = (ao(Ac), ai(A c ), • • • , ajc-i(A c )), 



where a<j(A c ) = Xi G Aj and i = 0, . . . , K — 1. Each K-taple 
(Ao, ■ ■ • , Afsr-i) is used only once when labeling points in A c 
in order to make sure that A c can be recovered unambiguously 
when all K descriptions are received. 

Since lattices are infinite arrays of points, we adopt the 
procedure used in [4]-[7], [13], [14] and construct a shift 
invariant labeling function, so only a finite number of points 
must be labeled. We generalize the approach of [5], [7] and 
construct a product lattice which has jV„. central lattice 
points and N^/Ni sublattice points from the ith sublattice in 
each of its Voronoi regions. The Voronoi regions of the 
product lattice A^ are all similar so by labeling only central 
lattice points within one Voronoi region of A^, the rest of 
the central lattice points may be labeled simply by translating 
this Voronoi region throughout R L . Without loss of generality, 
we let N-n — YiiLo 1 N{ and by construction we let A^ be a 
geometrical similar and clean sublattice of Aj as well as A c . 
With this choice of we only label central lattice points 
within V„-(0), which is the Voronoi region of A^ around origo. 
With this we get the following shift invariant property 
a(\ c + A*-) = a(A c ) + X^, 

for all Ajr G Ajr and all A c G A c . 

B. Rate and distortion performance 

Using standard high-resolution assumptions for lattice quan- 
tizers [16], the expected central distortion can be expressed as 



d c ^G(A c y/ L , 



(1) 



where G(A C ) is the normalized second moment of inertia [17] 
of the central quantizer and it can be shown that the side 
distortion for the ith description is given by [14] 

(2) 
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A c SV„(0) 

The minimum entropy R c needed to achieve the central 
distortion d c is given by [16] 

R c ^h(X)-^log 2 (u), (3) 

where h(X) is the component-wise differential entropy of the 
source. The side entropies are given by [14] 
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R. « h ( X ) - -l0g 2 (iV) 



(4) 



III. Construction of labeling function 

The index assignment is done by a labeling function a, that 
maps central lattice points to sublattice points. An optimal 
assignment minimizes the expected distortion when 1 < k < 
K — 1 descriptions are received and is invertible so the central 
quantizer can be used when all descriptions are received. 

A. Expected distortion 

At the receiving side, X G K L is reconstructed to a 
quality that is determined by the received descriptions. If no 
descriptions are received we reconstruct using the expected 
value, E[X], and if all K descriptions are received we recon- 
struct using the inverse map outlined above, hence obtaining 



the quality of the central quantizer. In all other cases, we 
reconstruct to the average 1 of the received descriptions. 

There are in general several ways of receiving k out of 
K descriptions. Let C denote an index set consisting of 
all possible k combinations out of {0, . . . , K — 1} so that 
\C\ = ( ). We denote an element of C by I = {Iq, . . . , l K -i}. 
The complement l c of / denotes the K — k indices not in I, 
i.e. 1° = {0, ...,K - We will use the notation d 

to indicate the set of all I € C that contains the index i, 
i.e., d = {I : I G C and i G 1} and similarly Cij = {I : 
I G C and i,j G I}. Furthermore, let pi be the packet-loss 
probability for the ith description and, consequently, let fa = 
1 — pi be the probability that the ith description is received. 
Finally, let p(l) = n i6 j Mi Ujel* Pi' = T,iecP( 1 )' 

p(&) = J2iec t P( l ) and P{£i,i) = J2ied j Pi 1 )- For example 
for K — i and k = 2 we have C = {{0, 1}, {0, 2}, {1, 2}} 
and hence p(C) = ^oMiP2 + M0M2P1 + Vi^Po- 

Upon reception of any k out of K descriptions we recon- 
struct X as X = i Yljel ^3 where the resulting distortion 
can be written similar to 0, e.g. if descriptions i and j are 
received, the norm in 10 should read ||A C — 0.5(aj(A c ) + 
It follows that the expected distortion is given by 



aj(\ c 



lec \ A c ev„(o) 



= ^ 4 + I 



E E 

AcGVW(O) iec 



p(l) 



3=0 



(5) 



where A^ = a\. (A c ) and the two special cases n G {0, K} 
are given by d^'°^ r ~ rli,Y ' ::r 



dcHf^Q 1 fa- 
B. Cost functional 
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From (0 we see that the distortion d a may be split into 
two terms, one describing the distortion occurring when the 
central quantizer is used on the source, and one that describes 
the distortion due to the index assignment. An optimal index 
assignment minimizes the second term in l|5} for all possible 
combinations of descriptions. We can rewrite this term using 
the following theorem 

Theorem 3.1: For any 1 < k < K we have 
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Proof: See [18] 
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'The average value of the received descriptions is equivalent to their 
centroid, since the pdf of X, under high-resolution assumptions, is constant 
within the region where elements of a _R"-tuple are located. 



The cost functional to be minimized can then be written as 
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(6) 



We minimize this cost functional subject to a constraint on 
the sum of the side entropies. We remark here that the side 
entropies depend solely on v and Ni and as such not on the 
particular choice of if -tuples. In other words, for fixed JVj's 
and a fixed v, the index assignment problem is solved if 
is minimized. The problem of choosing v and Ni such that 
certain entropy constraints are not violated is independent of 
the assignment problem and deferred to Section [V] 

The first term in (|6} describes the distance from a central 
lattice point to the weighted centroid of its associated if- 
tuple. The second term describes the weighted sum of pairwise 
squared distances (WSPSD) between elements of the K- 
tuples. It can be shown, c.f. Proposition l4.2l that, under a high- 
resolution assumption, the second term in (|6} is dominant, 
from which we conclude that in order to minimize we 
must use if -tuples with the smallest WSPSD. These if -tuples 
are then assigned to central lattice points in such a way, that 
the first term in (|6j is minimized. This problem can be posed 
and solved as a linear assignment problem [19]. 

C. Minimizing cost functional 

To obtain if -tuples we center a region V around all sub- 
lattice points Ao G Ao n V v (0), and construct if -tuples by 
combining sublattice points from the other sublattices (i.e. 
Aj, i = 1, . . . , if — 1) within V^(Ao) in all possible ways and 
select the ones that minimize (|6). For each Ao G Ao fl V w (0) 

wK-l ,5 



K-(O). To be optimal this restriction must be removed which 
is easily done by considering all cosets of each if -tuple. The 
coset of a fixed if -tuple, say t = (Ao, Ai, . . . , Xk-i) where 
A G A n T4(0), is given by Coset (i) = {t + A^}, for all 
Ajr G Ajr. The if -tuples in a coset are distinct modulo A^ 
and by making sure that only one member from each coset is 
used, the shift-invariance property is preserved. 

Before we outline the design procedure for constructing an 
optimal index assignment we remark that in order to minimize 
the WSPSD between a fixed \ and the set of points {Aj G 
A 3 f)V} it is required that V forms a sphere centered at A,. 

1) Center a sphere V at each Ao G AonV^-(O) and construct 
all possible if -tuples (Ao, Ai, . . . , Xk-i) where A, G 
Aj n V"(A ) and i = 1, . . . , K — 1. Notice that all if- 
tuples have their first coordinate (Ao) inside V^-(O) and 
they are therefore shift-invariant. Make V large enough 
so at least Nq distinct if -tuples are found for each Ao- 

2) Construct cosets of each A"-tuple. 

3) The Nn central lattice points in A c nV^-(0) must now be 
matched to distinct if -tuples. This is a standard linear 
assignment problem [19] where only one member from 
each coset is (allowed to be) matched to a central lattice 
point in V^-(O). 

As observed in [14], having equality in (0, i.e. using the 
minimum v, will not minimize the WSPSD. Instead a slightly 
larger region must be used. For the practical construction of 
the if -tuples this is not a problem, since we simply use e.g. 
twice as large a region as needed and let the linear assignment 
algorithm choose the optimal if -tuples. However, in order to 
theoretically describe the performance of the quantizers we 
need to know the optimal v. In [13], [14] an expansion factor 
ip was introduced and used to describe how much V had to 
be expanded from the theoretical lower bound {7), to make 
sure that the No optimal if -tuples could be constructed by 
combining sublattice points within the region V. Adopting 



it is possible to construct Yl i=1 N different if -tuples, where this approach leads to v = t\)vY[ 
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where e.g. 



Ni is the number of sublattice points from the ith sublattice 
within the region V. This gives a total of (N n /No) Ylf^ 1 JVi 
if -tuples when all Ao G Ao n V v (0) are used. Let v be the 
volume of V. Since Ni — v/vNi and we need No if -tuples 
for each Ao G V^-(O), we see that 
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so in order to obtain at least if -tuples, the volume of V 
must satisfy 



K-l 



v > v 



1/(K-1) 



(7) 



For the symmetric case, i.e. A^ = N, i = 0, . . . , if — 1, we 
have v > vN K '( K ~^\ which is in agreement with the results 
obtained in [13], [14]. 

By centering V around each Ao G AonV^O), we make sure 
that the map a is shift-invariant. However, this also means 
that all if -tuples have their first coordinate (i.e. Ao) inside 



for the two-dimensional case tp ks 2 (k ~ 2S > /( - k ~V [13], [14]. 
Analytical expressions for ip are given in [20]. 

IV. High-resolution analysis 

In this section we derive high-resolution approximations for 
the expected distortion. However, we first introduce Propo- 
sition 14.11 which relates the sum of distances between pairs 
of sublattice points to G(Sl), the dimensionless normalized 
second-moment of an L-dimensional sphere. Hereafter follows 
Proposition 14.21 which determines the dominating term in the 
expression for the expected distortion. 

Proposition 4.1: For Ni — ► oo and Vi — * 0, we have for 
any pair of sublattices, (Aj, Aj), i, j = 0, . . . , if — 1, ij^j, 

E lk(A c )-a,(A c )|| 2 

\ c £Vk(0) K-l 

^^' L v 2 / L G{S L )N„ J] nU L{K ~ 1) . 

rn—0 

Proof: Let T % = {A 4 : A, = ai (X c ), X c G V^(0)}, i.e. 
the set of N^ sublattice points Ai G Aj associated with the N v 



central lattice points within V^-(O). Furthermore let T[ C Ti be 
the set of unique elements of Ti, where \T!\ w N^/Ni. Finally, 
let Tj(Xi) = {Xj : Xj = a 3 -(A c ) and Aj = ai(A c ), A c G 
Kr(0)} so that Tj(Xi) contains all the elements Xj G A 3 which 
are in the i^T-tuples that also contains a specific A, G A*. Let 
Tj(Xj) C Tj(Xi) be the set of unique elements. 
For sublattice A,; and A 3 we have 

2 |MA c )-a,(A c )|| 2 = ]T J] ll^-^'ll 2 - 

A c eV w (0) A; GT' Aj 6Tj (A«) 

Observe that each Aj G K-(O) is used N n /\T(\ « times, 
so given A; G T[, we have 

E iiAi-Aiiis-^^ E ii^-^iiS 
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since Nj — v/vj. Hence, with v = iPvY]^_qN^I ^' 
have 

E ii*-a 3 -iiv 3 

\j£Tj(\i) K-l 

m— 

which is independent of Aj, so that 

E E ii*-a 3 ii 2 «§ E n*-M a 

AiST' A 3 ET 3 (Ai) * Aj GTj (A;) 
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which completes the proof. □ 
Proposition 4.2: Let fc be chosen such that Nk > Ni for all 
i,k£{0,...,K-l}. For iV, -> oo and Ilm=o ^™ > Aff ~ 2 

we have 







E 

A c 



A, 



77T) E;=o P(A)A, 



2 



Kp(£) 



EE E 1 f^P-^')) H*- A iH 2 

A c i=0 j=i+l v y 



Proof: See [18]. □ 
The expected distortion (|5} can by use of Theorem 13. II be 
written as 

K 1 
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By use of Propositions l4. Ill4~2l and Eq. Q it follows that (|8jl 
can be written as 

d {K,*) w G (A C )^/ L p(/:) 

m=0 

where /3 depends on AT and k and is given by 

The total expected distortion is obtained by summing over k 
including the cases where k — and k = K, 

K-l 

d a ^G(A c y/ L p(C)+E[\\X\\ 2 ] [] Pi 

1=0 (9) 

m— 

where = Y^=i Pi^) and = Ef=i Z 3 - 

Using (0 and (0} we can write the expected distortion as a 
function of entropies, which leads to 

K-l 

d a » G(A c )2 2 (' i W-^p(£) + £[||A|| 2 ] TT K 

r=o ( 10 ) 

+ ^ 2 / L pG(S L )2 2(h W- R ^2^( R <~i- «♦). 
V. Optimal quantizers 

In this section we consider the situation where the total bit 
budget is constrained, i.e. we find the optimal scaling factors, 
Ni and v, subject to entropy constraints on the sum of the side 
entropies J^i Ri < R*, where R* is the target entropy. We also 
find the optimal bit-distribution among the K descriptions. 

First we observe from JlOi that the expected distortion 
depends upon the sum of the side entropies and not the 
individual side entropies. In order to be optimal it is necessary 
to achieve equality in the entropy constraint, i.e. R* = i?,. 
From @ we have 

K-l K-l 

E Ri = E h W - ^log 2 (iV^) = R*, 

i=0 i=0 

which can be rewritten as 

f[(N i v) = 2 L ( Kh W- R ")=T*, (11) 

2 = 

where r* is constant for fixed target and differential entropies. 
Writing O as 

K-l 

T~T N 2/L(K-1) = V -2K/L(K-1) T VL{K-1) 
i=0 

and inserting in (|9} leads to 

K-l 

d a ^G(A c y/ L p(C)+E[\\X\\ 2 } J] Pi 
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The optimal v is found by differentiating d!2i w.r.t. v, equating 
to zero and solving for v, which leads to 



v = 2 L(h(X)-±R*) ^2/ 



R*) L1.2/L 1 G(S L ) (3 



■L(K--l) 
2K 



K - 1 G(A C ) p(£) 



(13) 

At this point we still need to find expressions for the optimal 
Ri (or, equivalently, optimal Ni given v). Let Ri = ciiR*, 
where J"J. <ij = 1, dj > 0, hence R* = J"J. i?^. From @ we 
have , 

iJ i = ft(X)--log 2 (JV i i/)=o i J?*, 

which can be rewritten as 

Ni = v - 1 2 L{h{x) ~ a * R '\ 

where, after inserting the optimal v from Jl 3i we obtain an 
expression for the optimal index value Ni, that is 



, G(A C ) p(C) 



L{K-1) 
2K 



G(S L ) 

It follows from (O that R c > c^iT so that a, < R c /R*. In 
addition, since rates must be positive, we obtain the following 
inequalities 

0<aiR*<R c , i = 0,...,K-l. (14) 

Hence, the individual side entropies Ri — a t R* can be 
arbitrarily chosen as long as they satisfy (114-1 and J"J. dj = 1. 

VI. Results 

To verify theoretical results we present in this section exper- 
imental results obtained by using 2 • 10 6 two-dimensional zero- 
mean unit-variance Gaussian source vectors. Fig. |2] shows the 
theoretical expected distortion l|9) and the numerical expected 
distortion obtained for K = 4 descriptions when using the 
Z 2 quantizer [17] at a total entropy R* = 8 bits/dimension. 
In this setup we have ip = 2^ K ~ 2 ^( K ~ 1 > and packet-loss 
probabilities are fixed at po = 2.5%, p% — 5%,j>2 = 7.5% 
except for p% which is varied in the range [1; 10]%. As p% 
is varied we update v according to (1131 and arbitrarily pick 
the index values Ni such that ^\ Ri < R*. However, index 
values are restricted to a certain set of integers [7], [14] and 
the side entropies might therefore not sum exactly to R*. To 
make sure the target entropy is met with equality we then 
rescale v as v = 2 L ^ X )-^ R *) Wf^ 1 N^ 1/K . We see from 
Fig. [2] a good correspondence between the theoretically and 
numerically obtained results. 
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